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Abstract 


Observations  of  developmental  plasticity  in  the  visual  cortex  of  cats  have  inspired  a 
number  of  theoretical  models.  These  models  attempt  to  mimic  the  development  of  response 
specificity.  We  review  the  assumptions  upon  which  one  can  build  models  of  the  visual  cortex. 

The  anatomical  layout  usually  consists  of  excitatory  aflerence  from  the  lateral  geniculate 
nucleus,  with  intracortical  inhibition  among  a  population  of  cells.  The  degrees  of  convergence 
of  the  aflerence  and  divergence  of  the  inhibition  are  some  of  the  more  important  considera¬ 
tions  which  distinguish  different  models.  Synaptic  modification  rules  lie  at  the  heart  of  these 
theories.  Modification  is  usually  of  the  Hebbian  type,  with  synaptic  strengths  changing  as 
some  function  of  the  product  of  pre-  and  post-synaptic  activity.  A  successful  model  not  only 
alters  synapses  to  generate  specificity  in  single  units,  but  simultaneously  produces  a  cortical 
network  which  is  stable  and  which  mimics  the  behavior  of  experimental  populations. 
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Introduction 

In  this  second  of  a  series  of  papers,  we  provide  the  modeling  details  of  a  study  in  neural 
development:  accounting  for  the  organization  of  orientation  selectivity  and  ocular  dominance 
in  neurons  of  kitten  visual  cortex.  In  the  first  paper26  we  offered  a  general  introduction  to 
modeling,  including  a  guide  to  simulation  techniques  and  error  analysis,  and  a  review  of  CAE 
software  packages  adaptable  for  neural  modeling. 

By  visual  cortex  (VC),  we  mean  kitten  primary  visual  cortex,  area  17  or  Vl.  We  do  not 
consider  extra-striate  cortex  here,  or  even  differences  between  cat  and  primate.  We  first 
review  some  pertinent  features  of  receptive  field  development ,  and  then  review  area  17  models 
which  use  the  anatomical  layout  to  account  for  RF  features,  incorporating  synaptic  excitation 
and  inhibition.  Then  we  show  how  to  model  synaptic  modification,  necessary  to  explain  plas¬ 
tic  changes  during  development. 

1.  Visual  response  specificity  in  kitten  and  adult  cat  neurons. 

Researchers  commonly  illustrate  specificity  or  selectivity  by  the  abstraction  of  a  tuning 
curve,  in  which  the  response  is  small  outside  of  a  narrow  range  of  preferred  stimuli.  In  the 
cat,  VC  specificity  is  found  over  the  dimensions  of 

•  receptive  field  (RF)  position, 

•  stimulus  orientation, 

,  •  spatial  frequency, 

•  length 

•  stimulus  velocity, 
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•  ocular  dominance. 

•  binocular  disparity. 

As  a  particularly  good  example  of  specificity,  we  show  in  Figure  1  a  disparity  tuning  curve 
from  a  cat  VC  cell. 

There  are  several  recent  reviews  of  kitten  visual  cortex  development24'39’68'99  which  the 
interested  reader  may  consult  for  details  beyond  the  information  presented  here. 

Since  we  are  interested  in  modeling  development  of  responses  in  kittens,  we  must  ask: 
How  do  visually  naive  kittens  and  adult  cats  differ  in  VC  specificity?  Although  this  is  an  area 
of  active  research,  and  there  are  a  number  of  controversies  about  the  degree  of  difference,  it 
can  be  said  with  some  conviction  that  kitten  neurons  lack  much  of  the  adult  selectivity.  To 
take  the  example  of  orientation  selectivity ,  a  number  of  quantitative  studies  have  shown  that 
only  a  low  percentage  of  cells  sampled  in  kittens  have  the  selectivity  for  orientation  seen  in  a 
majority  of  adult  neurons,’11’14’,5’3‘’88’98.  Many  cells  in  kitten  VC  respond  aspecifically  to  all 
stimulus  orientations  and  have  large  RF’s  with  poorly  defined  boundaries.  The  responses  may 
be  sluggish  —  with  few  spikes  per  presentation  and  fatigue  after  repeated  stimuli.  With 
regard  to  ocular  dominance  (OD)  immature  cells  usually  respond  well  to  stimuli  through 
either  eye,  and  often  show  mild  facilitation  when  tested  simultaneously  through  both  eyes. 
Selec  ivity  for  binocular  disparity  is  not  evident  in  immature  neurons88. 

In  contrast,  VC  cells  recorded  in  adult  cats,  or  even  kittens  with  several  weeks  of  normal 
visual  experience,  are  almost  all  selective  for  a  single  orientation,  and  direction  of  stimulus 
movement,  and  have  vigorous  responses  to  these  optimal  stimuli  (while  maintaining  a  precise 
plotting  of  RF  boundaries.  As  a  group,  these  cells  are  usually  binocular,  but  single  cells  oeea- 
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sionally  prefer  one  eye  or  the  other51.  The  RFs  for  the  two  eyes  are  similar,  but  may  be 
shifted  relative  to  each  other  for  detection  of  near  or  far  images18,72,73.  The  broad  binocular 
facilitation  seen  in  kitten  neurons  is  replaced  by  narrow  facilitation  plus  suppression  at 
disparities  neighboring  the  optimal  depth. 

Now  the  modeler  knows  the  initial  conditions  and  the  normal  end  result  of  VC  develop¬ 
ment.  Next,  consider  what  conditions  influence  the  time  course  of  normal  and  abnormal 
development. 

First  note  that  if  VC  neurons  are  to  develop  or  maintain  any  selectivity,  then  the  kitten 
requires  some  visual  experience.  Total  visual  deprivation  (rearing  in  absolute  darkness)  results 
in  virtually  no  orientation  selectivity  after  the  age  of  about  eight  weeks15,37,58,113.  It  should 
be  appreciated  that  even  with  dark  rearing,  the  afferent  axons  to  visual  cortex  have  some 
maintained  discharge.  It  is  possible,  with  enucleation  or  tetrodotoxin,  to  eliminate  this  “non- 
visual”  input,  too38,0'5,105. 

Now  let  us  list  a  number  of  abnormal  visual  environments  which  cause  VC  neurons  to 
develop  differently  from  normal. 

•  Temporary  monocular  deprivation  leads  to  permanent  ocular  dominance  (OD)  shift,  after 
which  almost  all  cells  give  no  response  to  the  deprived  eye112. 

•  Restricting  the  visual  world  to  contours  of  a  single  orientation  skews  the  distribution  of 
orientation  preferences  toward  the  experienced  pattern10,23,18,19,81,101. 

•  Limiting  vision  to  one  direction  of  motion  biases  VC  cells  to  respond  preferentially  to  that 
direction 

•  Kittens  raised  viewing  small  dots  develop  cells  with  normal  RF  size,  but  preference  for 
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unusually  small  spots  within  the  RF79,110. 

•  If  kittens  grow  up  in  low  temporal  frequency  strobe  light,  cortical  neurons  lose  direction- 
selectivity2c,22,2‘'4. 

*  ;  sing  prisms  to  deviate  the  image  in  one  eye  relative  to  the  other  results  in  a  compensatory 
shift  in  binocular  receptive  field  disparity90,91. 

2.  Outline  of  the  Model 

These  results  suggest  the  following  theory. 

At  birth,  each  VC  neuron  is  synaptically  connected  to  enough  afferent  input  so 
that  a  neuron  can  respond  weakly  to  a  great  many  stimulus  arrangements.  That 
subset  of  afferents  which  carries  information  during  repeated  presentation  of 
stimuli  finds  its  synapses  strengthened,  while  the  complement  of  that  active  subset 
finds  its  synapses  weakened.  By  this  use-disuse  mechanism,  the  cell  develops  a 
response  to  only  a  selective  set  of  stimulus  patterns. 

Modelling  this  sketchy,  qualitative  idea  presents  some  difficulties.  We  need  first  to 
specify  initial  conditions,  both  anatomical  and  physiological,  then  to  describe  how  a  cell  forms 
a  single  output  from  many  inputs,  then  to  express  a  rule  by  which  inputs  may  have  their 
influences  changed,  and  finally,  to  show  how  this  dynamic  system  with  many  cells  can  be 
stable  over  time. 

3.  Wiring  Diagram  for  the  Model 
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Four  structures  of  the  vertebrate  CNS  have  been  the  favorite  subjects  of  neuro- 
anatomists  over  the  last  century  -  retina,  spinal  cord,  cerebellum,  and  neocortex8'.  The  first 
three  of  these  have  a  limited  number  of  cell  types  and  a  constrained  set  of  connections 
between  the  cells.  The  neocortex,  however,  has  a  great  diversity  of  cell  types  and  a  rich  set 
of  interconnections.  See  Figure  2.  In  considering  how  nerve  cells  of  the  retino-geniculate 
pathway  are  interconnected,  the  modeler  has  an  embarrassment  of  riches. 

For  area  17,  visual  input  comes  principally  from  the  lateral  geniculate  nucleus  (I,GN). 
with  relatively  minor  inputs  from  the  pulvinar  and  the  claustrum83.  The  dorsal  LGN  is 
divided  into  layers,  physiologically  defined  by  ocular  dominance.  Each  layer  contains  cells 
excitable  through  one  eye  only.  Inhibitory  influences  from  the  oth<  r  eye  can  be  demon¬ 
strated,  however80.  Geniculate  units  show  biases  for  the  orientation  of  a  movingslit2,1,112. 
These  biases,  however,  fall  far  short  of  the  narrow  tuning  seen  in  cortical  neurons.  Modelers 
generally  assume,  therefore,  that  the  input  to  visual  cortex  has  neither  orientation 
selectivity  nor  binocularity. 

As  documented  by  Mountcastle66,  and  Hubei  &  Wiesel51,  neocortex  has  a  columnar 
organization.  Cells  recorded  in  a  penetration  perpendicular  to  the  cortical  surface  have  simi¬ 
lar  orientation  preferences  and  ocular  dominance  (although  cells  outside  of  layer  IV  are  gen¬ 
erally  binocular). 

In  addition  to  the  specific  alferents  from  thalamus,  there  are  widespread  non-visual 
inputs  to  VC':  a  noradrenergic  projection  from  the  locus  coeruleus,  a  cholinergic  from  basal 
nucleus,  and  a  serotonergic  from  raphe*1. 
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The  wiring  scheme  for  VC  models  consists  of  excitatory  afference  from  LGNT  combined 
with  intracortical  inhibition.  Intracortical  excitation  has  been  added  in  some  models  for  two 
main  purposes:  to  tighten  columnar  organization,  and  to  pass  the  signal  up  through  the 
hierarchy.  In  order  to  model  the  columnar  organization  of  cortex  described  above  (see  Figure 
7),  Malsburg62,  Swindale106,  and  others  have  studied  networks  with  short-range  excitatory 
intracortical  connections  and  longer-range  inhibitory  interactions.  Sillito8,  proposed  a  role  for 
intracortical  excitation  in  providing  a  baseline  facilitation.  Excitatory  projections  between 
cortical  layers  or  areas  can  create  reverberating  circuits  or  hierarchical  structures. 
Fukushima10  has  worked  with  abstract  feature-extracting  systems  of  several  levels.  Such  net¬ 
works,  when  plasticity  is  involved,  present  special  problems581.  One  way  to  deal  with  this 
complexity,  is  to  utilize  the  technique  of  supervised  learning.  Assume  the  desired  output  is 
available  to  produce  an  error  signal  between  the  actual  response  and  the  goal,  then  synaptic 
modifications  in  a  lower  layer,  based  on  the  error  signal  from  a  higher  layer  provides  the 
necessary  control.  Even  so,  sending  error  signals  back  over  more  than  three  layers  can  be 
costly,  computationally. 

Can  we  correlate  cell  types  from  anatomical  study  with  components  in  our  model  circuit? 
In  visual  cortex,  there  are  a  few  relationships  established  at  the  single-neuron  level.  Which 
cell  types  and  synapses  provide  inhibitory  and  excitatory  outputs  can  be  reasonably  guessed, 
but  response  properties  cannot  be  predicted  from  morphology.  On  e  can  assign  inhibitory  and 
excitatory  model  elements  to  smooth  and  spinous  stellate  cells  respectively85  or  focus  on 
basket  cells  as  powerful  inhibitory  elements  Daniels28.  Attempts  to  account  for  the  role  of 
each  type  of  cortical  cell  remain  speculative31. 
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It  is  the  first  task  of  the  modeler  to  decide  which  aspects  of  this  rich  (and  somewhat 
poorly  understood)  structure  are  essentia!  for  a  successful  wiring  diagram  of  the  model. 
Before  solving  this  problem,,  however,  the  modeler  must  consider  which  connections  are  exci¬ 
tatory,  which  are  inhibitory,  and  how  to  integrate  these  inputs  to  produce  responses  to  visual 
stimuli. 

4.  Excitation  and  Inhibition 

Excitation  in  VC  comesvia31 

•  the  specific  thalamic  afferent s. 

•  spiny  stellate  interneurons, 

•  collaterals  of  local  pyramidal  neurons, 

•  horizontal  fibers  in  layer  I, 

•  association  fibers  and  commisural  fibers  emanating  from  distant  cortical  pyramidal  cells, 

•  non-specific  subcortical  afferents'1. 

The  majority  of  VO  cells  receive  monosynaptic  excitation  from  LGN,  especially  cells  below 
layer  IIG\ 

Inhibition,  on  the  other  hand,  comes  almost  exclusively  from  local  interneurons31  and 
from  non-specific  afferents.  The  smooth  stellate  cells  are  usually  regarded  as  providing  inhibi¬ 
tory  outputs;  these  cells  include  basket  cells,  axoaxonic  cells,  axonal  tuft  cells,  and  double 
bouquet  cells'0.  GABA  is  probably  the  transmitter  for  these  neurons82,  and  their  synapses  are 
located  on  either  the  initial  segment  and  perikaryon,  or  the  dendritic  tree  of  pyramidal 
cells102.  Two  tv  pcs  of  GABA  receptors  have  been  distinguished,  and  both  localization  and 
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function  appear  distinct  for  these  receptors'  ■  . 

Rv  excitation,  we  will  generally  mean  monsynaptic  afferent  excitation;  inhibition  will 
always  be  polysynaptic  from  LGN.  This  intracortical  inhibition  is  sometimes  seen  as  simply 
an  inversion  of  the  sign  of  the  afferent  input  (e.g.  ref.  115),  but  it  should  be  regarded  as  an 
interaction  between  cortical  cells  since  inhibitory  cells  in  YC  have  selective  RFs65,  rather  than 
aspecific  LGN-type  fields. 

There  is  a  spectrum  of  thought  on  the  relative  importance  to  VO  specificity  of  excitatory 
and  inhibitory  mechanisms.  Hubei  and  Wiesel51  relied  on  excitation  to  illustrate  how  their 
data  on  oriented  RFs  could  be  derived.  Sillito08  argued  that  inhibition  generates  these  same 
RF  properties.  I  let  ween  these  extremes,  various  interactions  between  the  two  types  of  inputs 
have  been  proposed. 

Figure  3  represents  these  alternatives  in  terms  of  tuning  curves  for  the  excitatory  and 
inhibitory  inputs  to  a  cell.  Models  which  emphasize  excitation  assume  that  selectivity  arises 
through  tuning  the  excitatory  drive  to  the  cell,  with  a  relatively  flat  tuning  curve  for  inhibi¬ 
tion.  Hubei  and  Wiesel01  suggested  that  the  spatial  response  properties  of  VC  cortical  cells 
are  built  up  hierarchically  from  excitatory  convergence  via  non-sclective  LGN  cells.  They 
proposed  that  a  first  order  orientation-selective  cortical  cell  (simple  cell)  receives  excitatory 
inputs  from  center-surround  LGN  cells  whose  centers  were  offset,  but  aligned  along  the  long 
axis  of  the  preferred  orientation  (Figure  1).  Similarly,  ocular  dominance  can  result  from  the 
relative  strength  of  the  excitatory  input  of  each  eye.  Hubei  and  Wiesel  proposed  that  a  set  of 
simple  cells  preferring  a  common  orientation  excited  a  second  class  of  neurons  (complex  cells), 
conferring  their  orientation  selectivity  while  generalizing  over  a  larger  RF.  Subsequent 
work’1  showed  that,  bv  and  large,  simple  cells  are  stellate  and  complex  cells  pyramidal. 
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supporting  Hubei  and  Wiesel’s  model. 

Most  models  try  to  take  this  simple  excitatory  arrangement  as  far  as  possible  before 
introducing  inhibitory  factors.  Malsburg’s  model62  for  development  of  orientation-sensitive 
cells  features  a  hexagonal  lattice  of  input  elements.  The  elements  are  (he  centers  of  LGN 
receptive  fields.  His  stimuli  are  bars  which  excited  the  central  element  in  the  lattice,  and 
several  elements  on  each  side  (Figure  5a).  The  cortical  cells  develop  preferences  for  oriented 
stimuli  by  strengthening  the  connections  from  a  set  of  aligned  elements,  resulting  in  the 
arrangement  suggested  by  Hubei  &  Wiesel  (Figure  5b). 

Bienenstock  et  al.7,  started  with  inputs  generated  by  bars  overlapping  elements  on  a  lat¬ 
tice  (Figure  6).  Strong  excitatory  connections  from  one  of  these  oriented  inputs  come  to  dom¬ 
inate  a  VC  cell,  thereby  determining  the  cell’s  optimal  orientation. 

Each  of  these  models  follows  the  pattern  of  figure  3a,  where  the  excitatory  connections 
are  organized  essentially  in  the  form  of  the  preferred  input.  Each  model  also  implements  an 
additional  input  which  enhanced  selectivity  to  a  relatively  minor  degree,  through  inhibition  of 
non-optimal  patterns. 

Malsburg  combined  intracortical  interactions  of  short-range  excitation  and  longer-range 
inhibition  (see  Figure  7).  This  led  to  a  spatial  organization  of  the  cortical  layers  in  which 
neighboring  cells  developed  preference  for  similar  orientations.  Malsburg’s  long-range  inhibi¬ 
tion  brought  dissimilar  patterns  into  opposition.  Suppression  of  nonoptimal  patterns  through 
inhibition  was  also  used  by  Bienenstock  et  al.7  to  sharpen  orientation  selectivity.  Excitatory 
convergence  produced  the  basic  orientation  tuning  while  inhibition  suppressed  remnant 
responses  to  non-preferred  patterns,  essentially  by  raising  the  threshold.  This  overall 
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approach  implies  that  excitation  is  the  primary  carrier  of  selectivity  information,  and  that 
inhibition  is  used  secondarily  to  improve  tuning,  and  perhaps  add  a  stabilizing  influence. 

Others  have  considered  the  opposite  relationship  between  excitation  and  inhibition:  that 
most  of  the  selectivity  is  achieved  by  inhibition  of  all  but  the  optimal  pattern,  and  that  excita¬ 
tion  merely  provides  a  background  to  be  inhibited  (Figure  3c).  Creutzfeldt  et  al.19  pointed 
out  that  an  orientation-sensitive  cortical  cell  might  receive  excitation  from  a  single  LGN 
afferent4* ,67’95,  and  if  so,  then  it  should  show  no  selectivity  were  it  not  for  the  influence  of  an 
asymmetrical  intracortical  inhibition.  Heggelund  £  Moors46  proposed  that  oriented  RF’s 
result  from  two  circularly  symmetric  inputs  whose  centers  are  slightly  offset,  one  of  which  is 
inhibitory  and  the  other  excitatory  (Figure  8a).  Braitenberg13  extended  that  arrangement  to 
produce  a  tiro-dimensional  sheet  of  orientation-selective  cells.  Sillito97  proposed  further  ela¬ 
borations  of  Ileggelund’s  scheme  (Figure  8b)  using  several  stages  of  inhibition.  Barlow  £  Lev- 
ick4  and  llassenstein  £  Reichardt44  provided  experimental  evidence  that  direction-selectivity 
in  retinal  neurons  is  due  to  asymmetric  inhibition.  Cortical  direction  selectivity  depends  simi¬ 
larly  on  inhibition3318'56'9'.  DeValois  £  Tootell30  noted  an  asymmetric  inhibition  in  spatial 
frequency  tuning,  finding  inhibition  from  harmonics  of  the  best  frequency.  Furthermore, 
Hubei  and  Wiesel’s  strict  hierarchical  model  of  excitatory  convergence  from  LGN  to  simple 
cells  to  complex  cells  has  been  called  into  question  by  a  number  of  results  showing,  for  exam¬ 
ple,  that  complex  cells  receive  monosynaptic  inpt  from  LGN62'6*  and  respond  to  noise  stimuli 
which  fail  to  excite  simple  cells44.  The  evidence  for  a  complete  correlation  between  the 
stellate/pyramidal  and  simple/complex  classifications  has  also  been  weakened 12  ,>3,,,s. 

Sillito  has  argued  most  strenuously  for  the  alternative  illustrated  in  Figure  3c.  He 
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bicuculline96'101.  During  bicuculline  application,  normally  sharply  tuned  cells  lose  all  selec¬ 
tivity95.  Based  on  his  own  data,  as  well  as  other  evidence,  Sillito  concluded  that  the  excita¬ 
tory  input  from  LGN  has  a  flat  tuning  curve,  while  the  intracortical  inhibition  is  highly 
organized.  He  proposed  that  inhibition  “...is  optimally  effective  at  orientations  away  from  the 
preferred  optimum  and  hence  serves  to  generate  selectivity  to  that  optimum”  (101,  page  109). 
Sillito  places  intracortical  (not  afferent)  excitation  as  an  important  but  secondary  agent  in 
generating  RF  properties. 

We  suggest  that  both  excitation  and  inhibition  contribute  to  response  properties.  In  this 
compromise  view,  both  excitation  and  inhibiton  are  timed  around  a  common  optimum  (Figure 
3b).  Blakemore  and  Tobin8  found  examples  of  VC  neurons  which  were  inhibited  most 
effectively  by  gratings  parallel  to  the  cells'  preferred  orientations.  From  intracellular  record¬ 
ings.  Ferster35  produced  orientation  tuning  curves  of  the  type  in  Figure  3b.  Allman  et  al.2 
have  recently  reviewed  the  common  occurrence  of  extensive  input  from  outside  the  classical 
excitatory  RF,  and  discuss  the  evidence  that  inhibition  is  tuned  to  match  the  response  proper¬ 
ties  of  VC  cells. 

This  compromise  alternative  can  support  a  range  of  possibilities:  it  could  allow  excita¬ 
tion  to  be  broadly  tuned,  since  broadly  tuned  inhibition  would  effectively  eliminate  responses 
to  non-optimal  stimuli.  On  the  other  hand,  excitation  and  inhibition  could  both  show  sharp 
tuning.  Kither  way,  the  difference  between  this  compromise  situation  (Figure  3b)  as  opposed 
to  the  extremes  (Figure  3a  or  3c)  is  that  here,  excitation  and  inhibition  are  tuned  in  concert 
with  each  other  and  with  the  resultant  response. 

Different  response  dimensions  undoubtedly  draw  on  varying  mixtures  of  excitation  and 
inhibition.  Ocular  dominance  probably  depends  primarily  on  the  balance  of  excitatory  inputs 
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from  the  two  eyes,  whereas  directionality  and  binocular  disparity  probably  require  inhibition 
to  generate  sharp  tuning;  orientation,  spatial  position,  and  spatial  frequency  specificity  prob¬ 
ably  benefit  from  equal  combinations  of  inhibition  and  excitation. 

5.  Synaptic  Modification  Rules 

Once  a  reasonable  wiring  diagram  is  in  place,  and  connections  are  labelled  as  excitatory 
or  inhibitory,  a  rule  for  changing  connection  strengths  is  needed,  in  order  to  see  simulated 
development.  In  some  cases,  the  initial  wiring  is  assumed  to  have  excess  connections,  result¬ 
ing  in  little  specificity.  Synaptic  modification  then  eliminates  certain  connections.  Sometimes 
a  mild  topological  constraint  is  imposed  on  the  diffuse  initial  state:  cells,  including  afferent 
axons,  make  synapses  with  neighboring  cells,  rather  than  with  the  entire  network.  An  initial 
bias  in  the  wiring  is  necessary  in  Malsburg’s  systems65,66  because  a  seed  for  further  organiza¬ 
tion  is  needed.  Fluctuations  from  noisy  input  are  sufficient  to  break  the  initial  symmetry  and 
achieve  highly  asymmetric  final  states  in  Bienenstock  et.  al7. 

Various  combinations  of  modifiable  and  non-modifiable  synapses  have  been  employed. 
Each  of  the  alternatives  discussed  above  and  illustrated  in  Figure  3  corresponds  to  a  decision 
about  how  to  modify  excitatory  and  inhibitory  synapses.  Both  Malsburg65  and  Scofield90  used 
fixed  intracortical  synapses  and  modified  only  the  thalamocortical  excitatory  synapses.  Their 
results  are  of  the  type  in  Figure  3a.  Nagano  V  Kurata73  modeled  the  development  of  com¬ 
plex  cells  using  fixed  excitatory  synapses  from  LGN  and  modifiable  inhibitory  connections 
from  simple  cells,  giving  the  sort  of  inputs  described  by  Figure  3c.  The  natural  assumption 
to  make  to  obtain  the  results  of  Figure  3c,  or  even  Figure  3a,  is  that  active  inhibitory 
synapses  are  weakened  and  inactive  inhibitory  synapses  are  strengthened.  This  assumption 
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facilitates  responses  to  experienced  stimuli7,62,70.  In  order  to  arrive  at  the  inhibitory  tuning 
curve  of  Figure  3b,  one  can  assume  that  inhibitory  synapses  that  are  active  are  strengthened, 
just  as  for  excitatory  synapses.  Wilson118  modified  intracortical  inhibitory  synapses  in  this 
manner,  although  in  his  “anatomy”,  he  separated  the  inhibitory  cortical  cells  from  the  output 
cells,  essentially  reducing  the  inhibition  to  a  “retinal  afference”.  Saul89  modifed  both  excita¬ 
tory  afTerence  and  true  intracortical  inhibition,  showing  how  VC  cells  can  develop  specificity 
dependent  on  both  excitation  and  inhibition. 

Rules  for  synaptic  modification  span  a  broad  range:  see  Table  I.  Hebb'16  postulated  that 
learning  involved  an  increase  in  the  synaptic  efficacy  between  two  cells  which  were  simultane¬ 
ously  active.  His  rule  encodes  into  the  synapse  the  correlation  between  pre-  and  postsynaptic 
activity  (eqn  A  of  Table  Ij.  Many  others  have  started  with  Hebb’s  rule  to  create  different 
modifiable  synapses. 

Stent106  not  only  suggested  the  applicability  of  Hebbian  modification  to  the  visual  sys¬ 
tem,  but  also  proposed  a  specific  (though  speculative)  physiological  mechanism:  The  “ejec¬ 
tion”  of  neurotransmitter  receptors  from  the  postsynaptic  membrane  during  the  polarity 
reversals  which  accompany  cell  firing,  unless  local  synaptic  activity  stabilizes  the  receptors  by 
holding  the  membrane  potential  below  zero.  In  Stent’s  model,  activity  in  the  postsynaptic 
cell  during  inactivity  of  the  presynaptic  terminal  results  in  decreasing  the  strength  of  the 
synapse. 

In  order  to  increase  the  strength  of  a  synapse,  the  rule  can  uniformly  strengthen  (with 
low  gain)  all  synapses  on  the  postsynaptic  cell.  In  this  case,  inactive  synapses  lose  a  lot.  but 
add  only  a  little,  while  active  synapses  strengthen  slightly.  By  this  means,  the  modification 
of  Figure  9a  and  equation  B  is  obtained.  This  scheme  implies  that  no  change  occurs  in  the 
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absence  of  postsynaptic  firing,  and  is  sometimes  referred  to  as  postsynaptic  resonance83. 

Stent’s  mechanism  could  also  be  applied  to  inhibitory  synapses  (since  ipsps  would  cer¬ 
tainly  prevent  local  polarity  reversals),  where  the  modifications  turn  out  to  be  identical  to 
those  for  excitatory  synapses  (as  in  32,  89,  118;  see  eqns  C,  D,  M).  This  generates  the  tuning 
curve  in  Figure  3b. 

Von  der  Malsburg65  modified  his  excitatory  afferent  synapses  according  to  Hebb's  rule. 
Concurrent  activity  in  the  ith  LGN  cell  (  x^  0)  and  the  kth  cortical  cell  (yk^  0)  induces  a 
change  in  the  connection  strength  Asik  =  h  X;  yk.  To  be  able  to  decrease  strengths,  he  nor¬ 
malized  the  connections  onto  a  given  cortical  cell  to  result  in  a  constant  sum  of  all  their 
strengths.  Von  der  Malsburg  therefore  obtained  the  modification  “table”  of  Figure  9a  (and 
equation  E),  as  in  the  Stent-type  model.  Perez  et  al.80  followed  a  similar  procedure  (equation 
F),  strengthening  by  the  Hebb  rule,  followed  by  weakening  due  to  conservation  of  total 
synaptic  strength. 

Amari  <£:  Takeuchi3  also  follow  Hebb,  but  build  an  exponential  decay  term  into  their 
modification  rule  (Figure  9b  and  eqn  G  of  the  Table).  In  this  scheme,  strong  synapses  always 
decay,  setting  their  level  at  the  product  of  pre-  and  postsynaptic  activity.  Such  a  rule  is 
more  amenable  to  analysis  than  others,  which  must  be  simulated.  (Gilman  V  Schechtman113 
and  Easton  <fc  Gordon32  use  similar  rules  for  ease  of  analysis,  equations  K.  L,  and  M.)  They 
also  proposed  a  variant  with  the  property  of  postsynaptic  resonance,  shown  in  Figure  9a  and 
eqn  II.  Identical  rules  were  applied  to  excitatory  and  inhibitory  synapses.  They  used  a  single 
inhibitory  input  of  given  amplitude,  so  their  inhibitory  modifications  simply  provided  a 
threshold-setting  parameter  to  separate  categories  of  patterns  coming  in  through  the  excita- 
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tory  inputs. 

In  their  model  for  the  development  of  directional  selectivity,  Nagano  &  Fujiwara72 
assumed  that  active  inhibitory  synapses  weakened  as  in  Figure  9c  and  eqn  I.  Their  model 
produces  directional  preference  in  the  absence  of  other  features,  and  it  is  able  to  reproduce 
visual  deprivation-experiment  results  in  which  either  all  cells  preferred  a  single  experienced 
direction  or  no  cells  showed  directionality.  They  assume  that  a  cortical  cell  completely  inhi¬ 
bits  (vetoes)  its  neighbors.  The  modification  rule  permits  movement  in  the  preferred  direc¬ 
tion  to  eliminate  the  inhibitory  block,  which  remains  for  movement  in  the  null  direction  (as  in 
Figure  3c).  Note  that  this  modification  scheme  is  explicitly  time-dependent.  Any  of  the  other 
above  equations  can  be  made  to  depend  similarly  on  delays  between  pre-  and  post-synaptic 
firing. 

Rionenstock  et  al.‘  used  a  more  complicated  learning  rule.  They  replaced  the  postsynap- 
tic  factor  in  the  simple  Hebbian  product  (eqn  A)  by  a  nonlinear  function  of  both  the  post- 
synaptic  firing  and  a  modification  threshold  (which  is  in  turn  a  function  of  past  postsynaptic 
activity,  eqn  J).  The  form  of  this  function  weakens  synapses  when  postsynaptic  response  is 
small  and  strengthens  them  when  responses  are  large  relative  to  the  modification  threshold. 
The  modification  table  is  shown  in  Figure  9d,  although  the  actual  behavior  of  equation  J  is 
much  richer  than  this  caricature  since  the  modification  threshold  adapts  to  the  cell's  activity, 
as  will  be  discussed  below.  The  modification  rule  does  not  assume  postsynaptic  resonance, 
but  it  has  a  presynaptic  resonance  built  in,  as  well  as  an  implied  need  for  some  postsynaptic 
activity  to  raise  the  modification  threshold.  Bienenstock  et  al.‘  applied  this  rule  to  a  bipolar 
synapse  which  could  range  through  negative  and  positive  influences,  which  means  that  the 
modification  could  reverse  sign  as  in  1'igure  9e  when  the  synapse  passed  from  excitatory  to 
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inhibitory.  Scofield90  separated  the  bipolar  synapse  into  excitatory  and  inhibitory  parts  and 
chose  to  modify  only  excitatory  synapses,  applying  the  same  rule  (equation  J).  Analysis 
shows  that  the  two  key  reasons  this  rule  reproduces  some  of  the  classic  deprivation  results  are 
(1)  the  competition  induced  by  the  positive  and  negative  regions  of  the  6  -function  and  (2) 
the  stabilization  produced  by  pushing  the  positive  region  ahead  of  the  average  activity  of  the 
cell.  This  will  be  discussed  in  detail  in  the  next  section. 

Non-llebbian  rules  have  also  been  applied  to  visual  cortical  modeling.  Lara  &  Di 
Frisco59  modeled  interocular  competition  during  development  by  assuming  that  pre-svnaptic 
processes  such  as  post-tetanic  potentiation  and  heterosynaptic  inhibition  and  sensitization 
have  prime  importance.  Although  they  included  a  regulatory  influence  from  the  post-synaptic 
activity,  their  mechanisms  were  not  related  to  correlations  between  pre-  and  postsynaptic  ele¬ 
ments.  but  depended  on  competition  and  cooperation  only  between  pre-synaplic  fibers.  Swin- 
dale110  and  Malsburg05  obtained  similar  results  for  the  development  of  ocular  dominance 
stripes,  without  resorting  to  such  a  detailed  mechanism. 

6.  Stability  of  the  Selective  State 

There  are  a  number  of  different  slabilily  problems  inherent  in  developmental  specificity 
models.  The  key  feature  of  almost  all  these  models,  however,  is  that  states  which  represent 
selectivity  are  stable.  In  anthropocentric  terms,  selectivity  means  that  a  cell  “decides" 
whether  to  fire  based  on  “knowledge"  of  which  particular  inputs  are  firing,  and  can  therefore 
“make  decisions”  about  changing  its  state.  In  vector  terms,  most  modification  rules  move  the 
synaptic  state  (the  vector  of  synapses)  parallel  to  some  input  vector  until  the  state  nears  the 
equilibrium  point  corresponding  to  specificity  for  that  stimulus.  As  this  steady  state  is 
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approached,  the  modification  rule  becomes  dominated  by  the  decay  toward  the  selective  state. 
Amari  &  Takeuchi3  provided  an  elegant  demonstration  of  this  result.  The  steady  state  of 
equation  G  is  the  average  over  the  input  patterns  weighted  by  the  cell’s  responses  to  the  pat¬ 
terns.  Visual  experience  gives  synapses  a  chance  to  find  this  state  by  averaging  over  time. 
The  decay  term  ensures  that  any  transient  perturbations  are  attenuated. 

Hebb’s  postulate  is  often  seen  as  permitting  only  increases  in  synaptic  efficacy  in 
response  to  positively  correlated  activity.  Such  increases  cannot  continue  unbounded. 

Malsburg65  and  Perez  et  al.80  simply  normalized  their  synaptic  strengths  to  conserve  the 
total  strength  onto  a  cell.  This  normalization  provides  both  a  decrementing  process  and  a 
bound  on  synaptic  strength.  Their  normalization  is  instantaneous,  but  the  desired  results  can 
be  obtained  more  realistically  by  combining  a  fast  Hebbian  process  with  a  slow  asymptotic 
approach  toward  a  constant  sum  (eqn  B).  The  physiological  bases  for  conservation  rules  are 
finite  availability  of  transmitter  and  limited  number  of  post-synaptic  receptors.  Because  of 
enzyme  kinetics,  it  seems  reasonable  to  postulate  a  slow  change  in  transmitter  and  receptor 
distributions.  When  placed  in  a  model,  these  slow  processes  can  produce  an  apparent  consoli¬ 
dation  period  between  experience  itself  and  the  final  synaptic  strengths  wrought  by  that 
experience  [For  experimental  support,  see  16,  79;  but  see  37  for  the  opposite  result  .  In 
Wilson's  system118,  a  synaptic  conservation  hypothesis  helped  account  for  psychophysical 
data  on  adaptation  to  low  spatial  frequencies.  In  another  point  of  view,  Grossberg1,  has 
argued  that  a  simple  shunting-type  adaptation  can  replace  conservation  rules,  by  which  lie 
meant  simply  that  the  conservation  rule  can  be  shifted  to  the  presynaptic  layer,  since  strong 
inputs  from  one  presynaptic  cell  will  reduce  the  activity  in  other  presynaptic  cells  using 
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Cooper's  model'  relies  on  the  postsynaptic  activity  in  order  to  achieve  stability.  The 
form  of  the  <^>  -function  in  eqn  J  is  chosen  so  that  the  synaptic  weights  converge  to  appropri¬ 
ate  values  as  long  as  the  input  environment  is  stable  (in  the  sense  of  being  a  stationary  sto¬ 
chastic  process-  c.f.  ref.  6).  The  essence  of  the  <*>  -function’s  role  in  stability  is  that  the 
modification  threshold,  which  separates  the  weakening  and  strengthening  zones,  adapts  to  the 
cell’s  activity  in  the  following  manner:  0^  eventually  rises  above  all  responses  except  the 
response  to  a  single  optimal  pattern.  This  optimal  pattern  produces  improved  responses 
because  the  associated  6  is  positive,  whereas  <t>  is  negative  for  other  patterns,  leading  to 
reduced  responsiveness  to  those  non-optimal  patterns.  Once  these  non-preferred  patterns 
come  to  produce  no  response  at  all,  the  modification  threshold  catches  up  to  the  optimal  pat¬ 
tern  response  so  that  0  is  zero  for  all  patterns.  The  negative  slope  of  o  at  zero  response  sta¬ 
bilizes  the  non-optimal  patterns,  while  the  potentially  unstable  positive  slope  at  the  preferred 
pattern's  steady-state  response  finds  the  modification  threshold  varying  more  quickly  in  tin' 
same  direction  as  the  response.  At  the  steady  state,  this  adaptation  effect  dominates,  pushing 
the  ^  -function  back  toward  zero  (Figure  10). 

Suppose  a  model  moves  to  a  stable  state  during  exposure  to  a  particular  environment. 
What  will  happen  if  the  environment  changes?  Consider  the  “reverse-suturing"  paradigm 
where  a  formerly  closed  eye  is  opened,  and  the  other  eye  eluded,  while  -till  in  the  critical 
period.  An  OI)  shift  toward  the  last-opened  eye  is  seem1-*0  (I  igure  II)  We  can  regard  the 
reversal  as  a  breakdown  of  stability.  We  tlnn  might  presume  that  the  I  e  f  of  re\<  r-al  at  later 
ages  i.s  due  to  increased  stability  after  longer  exp.-ur-  t  •  tie-  ■  ■:  .■  n  d  •  .p.  n-ey  .•  . -n  v  ir-  •nment 
This  increasing  stability  accompanies  the  formation  .  f  |,  •  h  -•  1  •  n1  ,  f •  x 1 1 •  m<  mom  ,  u  1  nit  y 

in  the  reverse-silt  ure  example)  in  many  m  b'.  •  ••••  •  v .  t  -t.  ily- 
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environment  stability  is  often  unable  to  handle  drastic  change  in  the  stimulus  environment, 
and  in  models  such  as  Bienenstock  et  al.7  there  is  nothing  to  stop  another  complete  shift. 
Instead  of  relying  on  intrinsic  stability  therefore,  one  may  have  to  use  an  outside  gating  of 
plasticity,  as  has  been  suggested  by  various  experiments  (17,  36,  53,  103,  101).  Detailed 
models  for  external  gatinc  have  not  been  published,  but  we  should  expect  that  signals  derived 
from  the  state  of  \  isual  cortex  should  inform  the  gating  mechanism  so  that  plasticity  is 
reduced  at  the  appropriate  time,  i.e.  when  specificity  has  been  achieved.  In  what  form  this 
global  regulator  of  plasticity  arrives  at  the  local  visual  cortical  mechanisms  is  not  clear, 
although  this  is  an  active  area  of  research61.  The  next  generation  of  modeling  efforts  must 
include  global  control  mechanisms  to  modulate  local  synaptic  strengths. 


Summary 

We  review  models  for  development  of  selectivity  in  kitten  visual  cortex  neurons.  The 
models  rely  on  an  understanding  of  the  afferent  connections  to  YC.  and  on  the  intrinsic  con¬ 
nections  between  layers  in  cortical  columns.  Excitatory  and  inhibitory  labels  are  placed  on  the 
connections  in  the  model's  structure.  Modification  rules  for  some  of  the  synapses  allow  the 
model  systems  to  change  (develop)  in  response  to  a  visual  environment.  The  changes  stabilize 
on  states  which  represent  selectivity  in  singh'-nnit  responses,  provided  the  visual  environment 
it s<*| f  has  not  changed  greatly  during  the  development. 
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Table  I  --  Modification  Equations 

X;  =  i-th  retinal/geniculate  cell  activity 
yk  =  k-th  cortical  cell  activity 

s;k  =  weight  of  excitatory  connection  from  cell  i  to  cell  k 
qlk  =  weight  of  inhibitory  connection  from  cell  1  to  cell  k 

s  =  ds/dt,  A  s  =  sn  -  sn.j 

A)  Ilebb16  (excitatory):  Asjk  --  hXj  yk, 
h  is  a  time  constant  giving  learning  rate. 

cs  N 

B)  Saul89(excitatory):  sik  =  -  hs  (1-Xj)  yk  sik  +  —  (sok  -  £sjk), 

iN  j  =  i 

hs  and  c5  are  time  constants,  N  is  the  number  of  retinal  cells  projecting  to  cortical  cell 
k,  sok  is  the  constant  sum  of  synaptic  strength  onto  cell  k,  and  0  <\;.  yk<  1. 

c  M 

C)  Saul89  (inhibitory):  qlk  =  -  hq  (1-  y,)  yk  q,k  +  —  (qok  -  V  qhk), 

M  h-- 1 

analogous  to  B)  but  for  intracortical  inhibition. 

t 

D)  Wilson118  (inhibitory):  Aq|k  (t)  X  f  h(t-  r)  yt  (r)  yk  (r)  dr. 

O 

the  kernel  h  monotonically  decreases  toward  zero:  h( t )  —  c  \  X  a  constant. 

H)  Malsburg65  (excitatory):  Asjk  ohx;  yk  -  (l-o)  sik,  h  is  a  time  constant, 

N 

sok  X]  ( sjk  +  *ixj  >'k)’ 


O 
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sok  is  the  constant  sum  as  in  B. 

F)  Perez  etal80  (excitatory):  sik  =  hx;  yk  -  q  (1-x,)  sik, 

1  =  h  E  xj  >'k/  S  O-Xj)  sjk- 

j=i  i=i 

G)  Amari  and  Takeuchi3  (excitatory):  sik  —  -asik  +  hxj  yk, 
a,  h  are  time  constants,  yk  e  {0,  1}. 

H)  Amari  and  Takeuchi3  (excitatory):  slk  =  (-a  sik  +  hxj)  yk, 

0 ,  h  as  in  G. 

I)  Nagano  and  Fujiwara‘2(inhibitory):  Aq|k  (t)  —  (0  -  hx;  (t-2))  yk  (t), 

x;  and  yk  functions  of  (discrete)  time,  a,  h  positive  time  constants,  0<  xmin  <  x;  < 
x rn ax  "’hon  cell  i  is  excited,  X;  otherwise,  and  a  -  hxmin  <0. 

J)  Bienenstock  etal.'  (excitatory  and  inhibitory):  sik  =  $  (yk,  0N1)  xit 

<t>  a  particular  function  of  yk  and  with  0^  being  a  modification  threshold  which  is 
a  function  of  yk,  a  running  time  average  of  yk  —  see  Figure  10. 

K)  Ullman  and  Sehechtman113  (excitatory):  Asik  —  h(a  -  sik  Xj)  h(a  -  yk), 
a  a  constant  norm,  h  a  time  constant. 

L)  Fast  on  and  Gordon32  (excitatory):  slk  -  hs  (\j  yk  -  sik), 
hs  a  time  constant. 

M)  Faston  and  Gordon3"  (inhibitory):  (]]k  h  (yk2  -  <|kk), 
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Position  disparity 

Figure  1.  Binocular  disparity  tuning  curve  from  a  cat  VC  simple  cell,  from  Nelson  et  al.  1977.  reproducea 
with  permission.  This  cell  is  sharply  tuned,  responding  over  about  1  °  of  retinal  disparity.  The  0°  reference 
is  somewhat  arbitrary.  Misalignment  of  the  two  retinal  images  from  their  optimal  positions  leads  to  sup¬ 
pression  of  the  response  below  the  level  of  the  monocular  responses.  The  dashed  line  shows  the  response 
to  the  left  eye  stimulus  alone,  which  was  fixed  for  this  curve.  The  right  eye  stimulus  was  advanced  or  delayed 
from  its  optimal  position.  The  short  continuous  line  shows  the  sum  of  the  monocular  responses  at  the  op¬ 
timal  positions.  Binocular  stimulation  thus  produces  facilitation  over  a  narrow  range  of  disparities. 


Pjpj  j| ” 1^2 p|p| 


% 


Table  1.  Modification  Equations 


x  =i-th  retmal/gemculate  cell  activity 
y.  =  /<-th  cortical  cell  activity 

s..  =  weight  of  excitatory  connection  from  cell  i  to  cell  k 
g,.  =  weight  of  inhibitory  connection  from  cell  I  to  cell  k 
s  =  ds/dl.  A  s  =  s.  -s..., 

A  Hebb'"  (excitatory):  As .  =  hx  y,. 

h  is  a  time  constant  giving  learning  rate 

B  Saul"  (excitatory)  s .  =  -  h  (1  -  x  )y.s .  +  -(. s  .  -  —  s .). 

N  * 1 

h  and  c  are  time  constants  N  is  the  number  of  retinal  cells  proiectmg  to  cortical  cell  k.  s  .  is  the  con¬ 
stant  sum  of  synaptic  strength  onto  cell  k,  and  0  sx.y,  <  1 

C  Saul"  (inhibitory)  g,.  =  -  h,(1  -  y  )y,g..  +  — (g  .  -  D  <?..). 

M  ‘ 

analogous  to  8  but  for  mtracortical  inhibition 

i 

D  Wilson'1-  (inhibitory):  Ag,.(f)  =  V  h(l  -  r)y,(r)y.(r)dr. 

o 

the  kernel  h  monotomcally  decreases  toward  zero:  d(f)  =  e '.  \  a  constant 
E  Malsburg  *  (excitatory):  As .  =,.hx  y.  -(1  -..Is ..  h  is  a  time  constant. 


<-*-/£(».. 


+  hx  y«). 


s  .  is  the  constant  sum  as  in  B 
F  Perez  et  al  "  (excitatory)  s .  =  hx  y.  -  -,(1-x  )s .. 


' /  Eo  -x,)s,.. 


G  Amari  and  Takeuchi1  (excitatory),  s  .  =  -  «.s  .  +hx  y.. 

...  h  are  time  constants,  y.  <  (0.  1  (. 

H  Amari  and  Takeuchi'  (excitatory):  s,.  =(  -..s  .  +  hx)y., 

.I,  h  as  m  G 

I.  Nagano  and  Fujiwara,J  (inhibitory):  Ag,,(f)  =  (n  -  hx,(t  -  2))y,(f), 

x.  and  y,  functions  of  (discrete)  time.  <».  h  positive  time  constants.  0  <  xmin  <  x  <  x_,aji  when  cell  ns  ex¬ 
cited.  x.  =  0  otherwise,  and  «  -dxmin<0. 

J  Bienenstock  et  al.’  (excitatory  and  inhibitory):  s.  =  o(y..O„)x . 

o  a  particular  function  of  y,  and  O,,  with  ()„  being  a  modification  threshold  which  is  a  function  of  y., 
a  running  time  average  of  y,— see  Figure  10. 

K.  Ullman  and  Schechtman'"  (excitatory):  as.,  =  /)(«  - s  .x )  =  b(<»  -  y,). 

<»  a  constant  norm,  h  a  time  constant. 

L.  Easton  and  Gordon  '*  (excitatory):  s'..  =  h  (x  y .  -  s,.), 
h.  a  time  constant. 

M  Easton  and  Gordon'1  (inhibitory): <7,.  =  h,{y.‘  -  g..), 
h,  a  time  constant. 
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Figure  2.  Schematic  diagram  of  cortical  organization.  Specific  inputs  arrive  via  the  X.  Y.  and  W  pathways 
from  IGN  Layer  IV  contains  stellate  cells  and  some  small  pyramidal  cells  with  stellate-like  dendritic  ar¬ 
borizations  Simple  type  receptive  fields  (S)  predominate.  Other  layers  contain  predominantly  pyramidal 
cells  Their  fields  can  be  simple  or  complex  (C).  Smooth  stellate  cells  can  be  found  throughout  cortex, 
however,  and  one  of  these  is  illustrated  in  layer  II  as  a  basket  cell  Outputs  from  superficial  layers  project 
10  other  cortical  locations,  while  layers  V  and  VI  project  to  superior  colliculus  and  LGN  respectively 
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Figure  3.  A  simplified  view  of  the  possibilities  for  tuning  of  excitatory  and  inhibitory  inputs  to  a  cell  (A) 
Excitation  is  tuned  and  generates  the  final  response  tuning  with  little  contribution  from  inhibition  The  in¬ 
hibitory  input  may  be  strong,  but  it  is  relatively  flat.  Inhibition  may  be  reduced  at  the  optimum  in  order 
to  facilitate  response  (B)  Both  excitation  and  inhibition  are  tuned  in  concert  with  the  response  they  share 
a  common  optimum.  Both  types  of  inputs  contribute  to  the  final  response  tuning  (C)  inhibition  is  highly 
tuned  while  excitation  is  flat.  The  inhibition  serves  to  eliminate  response  to  nonoptimal  stimuli  while  not 
blocking  optimal  stimuli.  The  excitation  provides  only  a  background  drive 
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Figure  4.  Hypothetical  construction  of  an  oriented  VC  cell  RF,  from  Hubei  &  Wiesel  1962,  reproduced 
with  permission,  A  large  number  of  LGN  cells,  including  the  four  cells  with  the  ON-center/OFF-surround 
fields  at  the  left,  project  onto  the  cortical  cell  at  the  bottom  right.  This  cortical  cell  would,  therefore,  be 
endowed  with  the  RF  indicated  by  the  dashed  outline. 
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Figure  5.  Von  der  Malsburg  (1973)  modeled  the  development  of  oriented  RFs  by  assuming  an  excitatory 
proiection  from  retina  to  cortex.  (A)  The  19  retinal  cells  were  arranged  in  a  hexagonal  array,  and  nine  stand¬ 
ard  stimuli  were  formed  as  indicated  by  the  large  or  small  dots  which  corresponded  to  active  or  inactive 
retinal  cells  (B)  The  response  of  one  of  the  cortical  cells  is  shown  At  the  top,  the  responses  to  each  of 
the  nine  standard  stimili  are  drawn  for  three  points  in  time:  before  learning,  after  20  learning  trials,  and 
after  100  learning  trials  took  place.  Initially,  the  cell  was  relatively  aspecific  (though  biased),  but  by  the 
end  had  become  selective  for  patterns  #7  and  »8  The  dashed  line  shows  the  firing  threshold,  and  the 
dashed  curve  on  the  right  shows  the  response  after  removal  of  inhibition  The  second  row  gives  the  net 
afferent  input  for  each  pattern  In  the  third  row,  the  heights  of  the  bars  represent  the  synaptic  strengths 
from  each  retinal  fiber  onto  the  cell  Synapses  which  are  active  during  presentations  of  patterns  »7  and 
#8  are  the  only  remaining  connections.  Reproduced  with  permission. 


Figure  6.  The  pattern  generator  used  in  simulations  of  Cooper's  model  consisted  of  19 
bar  was  projected  on  this  array,  and  the  area  of  each  cell  which  was  covered  by  the  bar  p 
for  the  activity  in  that  cell.  " 
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Figure  7.  An  often-assumed  intracorneal  wiring  scheme  is  short-range  excitation! - >)  and  longer- 

range  inhibition  ( - 1).  These  connections  can  be  used  as  a  force  to  produce  columnar  organization, 

with  cells  in  a  column  providing  mutual  excitation  and  cells  in  neighboring  columns  providing  mutual 
inhibition. 


Figure  8.  {A)  Heggelund  and  Moors  (1984)  hypothesized  that  orientation  selectivity  arises  from  overlap¬ 
ping  subfields  of  opposite  effect  Each  subfield  is  circular,  but  the  partial  overlap  leaves  an  elongated  ex¬ 
citatory  zone  exposed.  Reproduced  with  permission.  (B)  A  more  complex  diagram  from  Sillito  (1985)  which 
uses  the  scheme  in  A  (upper  left).  In  the  upper  right.  Ibree  of  Ihese  channels  interact  to  produce  a  second¬ 
ary  field  with  enhanced  selectivity  At  the  bottom,  the  inhibitory  fields  are  large  relative  to  the  excitatory 
field  ("1")  and  field  "2"  is  mixed  inhibitory  and  facilitatory.  The  inhibitory  interactions  now  include  several 
types  of  lateral  proiections,  along  with  a  feedback  from  the  secondary  units  (triangles)  to  the  primary  cells 
(circle  in  middle)  Reproduced  with  permission. 
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Figure  9.  Modification  tables  for  various  Hebb-type  rules.  See  text  for  details.  PRE  =  presynaptic  activi¬ 
ty.  POST  =  postsynaptic  activity  The  tables  show  the  sign  of  the  synaptic  change:  +  =  increase  strength. 
-  =  decrease  strength,  0  =  relatively  little  change,  c  and  e  are  for  inhibitory  synapses,  where  anti-Hebbian 
rules  have  sometimes  been  applied,  which  accounts  for  the  -  sign  in  the  bottom  right  quadrant,  rather 
than  the  Hebbian  +  sign.  Os  in  the  first  column  indicate  postsynaptic  resonance,  in  which  postsynaptic  activity 
is  required  to  gate  modifications. 


Figure  10.  The  o-function  of  equation  J,  after  Bienenstock  et  al.  1982.  q  is  a  function  ot  postsynaptic 
activity  and  a  modification  threshold  <f„.  For  fixed  q  is  positive  for  y<0.  q  is  negative  for  0 
and  o  is  positive  for  y  >0„  (see  Figure  9d).  Flowever,  t)„  is  a  function  of  the  average  postsynaptic  activity, 
which  oecomes  very  important  at  the  steady-state,  when  y  =  tr„.  Under  appropriate  conditions,  this  nonlinear 
dependence  of  on  y  effectively  curves  the  o-function  back  toward  zero  locally  around  the  equilibrium 
point  (dashed  curve). 
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Figure  11.  Increasing  resistance  to  ocular  dominance  shift  toward  the  last-opened  eye  after  reverse-suture 
at  later  ages,  from  Blakemore  and  Van  Sluyters  1974,  reproduced  with  permission.  The  reversal  index 
is  the  proportion  of  cells  dominated  by  the  last-opened  eye.  The  dashed  line  at  0.0  is  the  reversal  index 
for  a  control  animal,  which  was  initially  deprived  until  5  weeks,  but  not  reversed-sutured.  These  data  show 
that  plasticity  decreases  and  stability  increases  during  the  critical  period.  This  stability  could  depend  solely 
on  age  but  it  may  also  rely  on  visual  experience,  since  the  older  reverse-sutured  subjects  had  longer  in¬ 
itial  deprivations. 


